🕷️️ Job Radar • SCRAPING

upwork.com 🟡 2026-05-08

🔹 Technical Manifest: Data Scraper for JSON Compilation
👤 Client: 🇺🇸 USA Member since 2025-09-23
💰 Price: ****
🚩 Problem: Need expert data scraper to compile and structure raw job descriptions into a structured Technical Manifest (JSON) for website projects.
📦 Existing: Not specified

Specifications:

[Target] - Compile school logos and other project-specific data from web sources into a structured JSON format.
[Method] - Use web scraping techniques with Python libraries like BeautifulSoup or Scrapy. Ensure compliance with legal and ethical guidelines.
[UI/UX] - Not applicable for this task.
[Stack] - Python, BeautifulSoup, Scrapy, JSON
[Security] - Implement error handling to manage network issues and ensure data integrity. Use secure coding practices to prevent vulnerabilities.
[Format] - Output structured JSON files with clear key-value pairs.

Workflow:

1. Analyze project requirements for specific data points needed (e.g., school logos, descriptions).
2. Identify appropriate web sources and URLs containing the required information.
3. Develop or select a Python script using BeautifulSoup or Scrapy to scrape the identified sources.
4. Test the scraper on sample data to ensure accurate extraction of relevant information.
5. Refine the scraping logic as necessary based on testing results.
6. Execute the scraper on all required URLs and compile the data into structured JSON files.
7. Validate the compiled JSON files for accuracy and completeness.